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Abstract 

(N ; 

-Cj ■ Consider the controlled system dx/dt = Ax + a(t)Bu where the pair (A, B) is stabilizable and a(t) 

^ , takes values in [0, 1] and is persistently exciting, i.e., there exist two positive constants ^i,T such that, for 

every t > 0, J. a(s)ds > /i. In particular, when a(t) becomes zero the system dynamics switches to 
C*") ' an uncontrollable system. In this paper, we address the following question: is it possible to find a linear 

time-invariant state-feedback u — Kx, with K only depending on (A, B) and possibly on fX,T, which 
globally asymptotically stabilizes the system? We give a positive answer to this question for two cases: 
, when A is neutrally stable and when the system is the double integrator. 

Notation. A continuous function : M>o — > R>o is of class K, {(f> E K), if it is strictly increasing and 0(0) = 0. 
| ip : K>o — > M>o is of class C (i/j E C) if it is continuous, non-increasing and tends to zero as its argument tends 
■ to infinity. A function /3 : K>o X R>o — > K>o is said to be a class ICC-function if, /?(•, t) E JC for any t > 0, and 

/3(s, •) € £ for any s > 0. We use |-| for the Euclidean norm of vectors and the induced L2-norm of matrices. 

r -1 ' 1 Introduction 

> , 

In the paper [9] we posed the following problem: consider the system x — f(t, x) + u with x € K" and the 
. stabilizing control u = u* . Consider now the system 

x = f{t,x)+a(t)u, (1) 

o 



where rank{a(i)} ^ n for certain times t {i.e. a may be rank-deficient over possibly "large" intervals of 
time). Under which conditions imposed on a does the closed-loop system (1) with the same control u* 
\ is asymptotically stable? It must be stressed that a complete knowledge of a (and, in particular, precise 

■ information on the set of times where it is rank deficient) would be a too restrictive condition to impose on 
a. We are rather looking for a condition valid for a whole class Q of functions a and, therefore, we expect the 
closed-loop systems (1) with u* to be asymptotically stable for every a E Q. 

In order to characterize such a condition, let us consider a similar problem stemming from identification 

■ and adaptive control. It concerns the linear system x = —P(t)u, where the matrix P(-) is symmetric non- 
5h I negative and now plays the role of a. If P = I then u* = x stabilizes the system exponentially. But what 

if P(t) is only semidefinite for all t? Under which conditions does u* = x still stabilize the system? For this 
particular case the answer to this question can be found in the literature: from the seminal paper [10] we 
know that for the system 

x = -P(t)x (2) 

with x E M" , P > bounded and with bounded derivative, it is necessary and sufficient, for global exponential 
stability, that P be also persistently exciting (PE), i.e., that there exist fi > and T > such that 

' +T ep(T)a>v (3) 
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for all unitary vectors £ £ K ra and all t > 0. Therefore, as regards the stabilization of (1), the notion of 
persistent excitation seems to be a reasonable additional assumption to consider for the signals a. 
In this paper, we focus on n-dimensional linear time-invariant systems 



x = Ax + a{t)Bu , (4) 

where the input perturbation a is a scalar PE signal, i.e., a takes values in [0, 1] and there exist two positive 
constants /i, T such that, for every t > 0, 

t+T 

a{s)ds > fx. (5) 

Given two positive real numbers /i < T, we denote by Q(T,fi) the class of all PE signals verifying (5). Note 
that we do not consider here any extra assumption on the regularity of the PE signal a (e.g. having a bounded 
derivative) . 

An interpretation of the stabilization mechanism can be given, in the case of scalar systems of type (2), 
in terms of "average". Roughly speaking, one can dare say that, even though it is not the control action u* 
that enters the system for each t, this "ideal" control does drive the system "in average" . Indeed, for t > 0, 
set (a)(t) := i f* +T a(s)als for any PE signal a. Then, along non-trivial trajectories of x(t) = —a(t)x(t), one 
has for every t > 0, 

1 f x(t + T) \ 1 f t+T x(s) 

The control action u = —a{i)x which, in average, corresponds to u = — (a)(t)x, is tantamount to applying 
u* = —x, modulo a gain-scale that only affects the rate of convergence but not the stabilization property of 
u* . Of course the previous naive thinking largely relies on the fact that we are dealing with a scalar system. 
Indeed, persistency of excitation does not guarantee the existence of an averaged system in the sense of e.g. 
[14]. This observation makes all the related techniques unapplicablc. 

Our main goal in this paper consists of stabilizing (4) to the origin with a linear feedback. Therefore, we 
will assume in the sequel that (A, B) is a stabilizablc pair. It is obvious that if a = 1, for a proper choice 
of K , we have that the control u — u* with u* = Kx renders the closed- loop system globally exponentially 
stable. If a is not constant, consider the following question: 

(Ql-0) Docs u = a(t)u*, with a an arbitrary PE signal, stabilize (4)? 

For systems of the type (4), the answer to Question (Ql-0) is negative in general. Indeed, the scalar case 
essentially corresponds to stabilizing x(t) = Xx(t) + a(t)u. Using the linear feedback u* = kx for some k < 0, 
one gets, after simple computations, that for t > 0, 

\ ln (~^r) = A + {a){t)k ^ x+ ^ (6) 

if a is a PE-signal verifying (5) for some fixed positive constants /U < T. One deduces from (6) that global 
exponential stabilization occurs if the negative constant k is chosen so that k < — ^A. If A > 0, then the choice 
of u* = kx depends on /i, T, the parameters of the PE-signal. Therefore, question (Ql-0) may only receive a 
positive answer for systems (4) with A marginally stable, i.e. all the eigenvalues of A have non-positive real 
part: 

(Ql) Given A marginally stable, does u = a(t)u*, with a an arbitrary PE signal, stabilize (4)? 

Intuitively one may think that the global exponential stability of the closed-loop system is guaranteed, at least, 
for a particular choice of K and a particular class of PE functions a. In that spirit, consider the following 
question: 

(Q2) Given a class G(T, of PE signals, can one determine a linear feedback u* = Kx such that 
u = a{t)u* stabilizes (4), for all PE signal a in Q(T,fi)? 

While, for the scalar case, the answer is clearly positive (as shown previously), the general case n > 1 is 
fundamentally different and, in view of the available tools from the literature of adaptive control, a proof (or 
disproof) of the conjecture above is far from evident. A first step in the solution of (Q2) for the case n = 2 has 
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been undertaken in [9] where we showed that, for certain persistently exciting functions a and certain values 
of K, exponential stability follows. We underline the fact that, in Question (Q2), the gain K is required to 
be valid for all signals in the considered class. 

A particular case of this problem may be re-casted in the context of switched systems -cf. [7]. Indeed, 
consider the particular case in which the PE signal a takes only the values and 1. In this setting, the system 
(4) after the choice u = u* = Kx, switches between the uncontrolled system x = Ax and the exponentially 
stable system x = (A + BK)x. At this point, it is worth emphasizing that since switches occur between a 
possibly unstable dynamics and a stable one, Lyapunov-based conditions for switched system between stable 
dynamics are inapplicable; see for instance [12] for results using common quadratic Lyapunov functions, [2, 4] 
for theorems relying on multiple Lyapunov functions and also [1] for a more geometric approach. 

The first issue we address in this paper regards the controllability of (4) uniformly with respect to a G 
Q(T,n). If the pair (A, B) is controllable, we prove that (4) is (completely) controllable in time t if and only 
if t>T-fi. 

We next focus on the stabilization of (4) by a linear feedback u = Kx, that is, we address Question (Q2) 
for system (4). Namely, we look for the existence of a matrix K of size mxn such that, for every a € Q{T, //), 
the origin of the system 

x = (A + a(t)BK)x 

is globally asymptotically stable. It is of course assumed that (A, B) is stabilizable. We first treat the case 
where A is neutrally stable. We actually determine a feedback K as required, which in addition provides a 
positive answer to Question (Ql) posed for system (4). 

Finally, we consider the case of the double integrator , that is, 




In [9] we already studied such a system under the assumption that a is PE. The solutions given in 
that paper, however, do not bring a complete answer to the questions posed above: the first solution relies 
on backstepping and, therefore, requires a bound on the derivative of a while the second is based on a 
normalization of a and imposes a relationship between the parameters T and /i involved in the persistency of 
excitation. In the present paper, we bring a positive answer to Question (Q2) for every class G(T,fi) of PE 
signals and a negative answer to Question (Ql). 

The rest of the paper is organized as follows. In coming section we provide the main notations and the 
result on the controllability of multi-input linear systems subject to PE signals. We discuss stabilization issues 
in Section 3 for A neutrally stable and in Section 4 for the double integrator, first in case of a scalar control 
and then in a more general setup. We close the paper with an Appendix which contains the proof of a crucial 
technical result. 



2 Notations and basic result on controllability 

In this paper, we are concerned with linear systems subject to a scalar persistently exciting signal, i.e., systems 
of the type (4) where a is a PE signal. The latter is defined as follows. 

Definition 1 ((T, ( u)-signal) Let ^ < T be positive constants. A (T, /x)-signal is a measurable function a : 
R>o — > [0, 1] satisfying 

rt+T 

J a(s)ds>n, VteR> . (7) 

We use G(T,n) to denote the set of all (T, (i)- signals. 

Notice that, for any such signal a, existence and uniqueness of the solutions of (4) is guaranteed. 
Remark 2 If a(-) is a (T, /x)-signal, then, for every to > 0, a(to + •) is again a (T, /x)-signal. 

Our first result studies the following property for (4). 
Definition 3 (Controllability in time i) We say that system (4) is controllable in time t > for Q(T,n) 
if for every a £ Q(T,/j,), the time-varying linear controlled system defined by (4) is completely controllable in 
time t. 
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More precisely, we establish the following result on the controllability of system (4) . 
Proposition 4 Let fj, < T be two positive constants and (A, B) a controllable pair of matrices of size n x n 
and n x m respectively. Then, system (4) is controllable in time t for Q(T,fi) if and only if t > T — fi. 

Proof of Proposition 4. Following the classical proof of the Kalman condition for the controllability of 
autonomous linear systems (cf.e.g [13]), it is easy to see that the conclusion does not hold if and only if there 
exists a non-zero vector p G K™ and a (T, /x)-signal a such that the function 

a{s)p T e A{t - s) B = 0, a.e. in [0,t]. (8) 

If t > T — (j,, there exists a subset J of [0, T] of positive measure such that a(s) > for s G J. Therefore, 
the real-analytic function s i-> p T e A ( t ~ s 'B is equal to zero on J C [0, T]. It must then be identically equal to 
zero, which implies that (A, B) is not controllable. We reach a contradiction and one part of the equivalence 
is proved. If t < T — \i, Q(T,/j,) contains a PE-signal identically equal to zero on time intervals of lengtht t 
and any non-zero vector p verifies (8). ■ 
The rest of the paper is concerned with the stabilization of (4). We address the following problem. Given 
T > pL > 0, we want to find a matrix K of size m x n which makes the origin of 

x = (A + a{t)BK)x (9) 

globally asymptotically stable, uniformly with respect to every (T, /x)-signal a [i.e., K is required to depend 
only on A, B, T and fj, and to be valid for all signals a in the class Q(T, fj,)). Referring to 

x(-;t ,x ,K,a) = (xi(- ; to, x , K, a), . . . , x n {- ; t , x , K, a)) T , 

as the solution of (9) with initial condition x(fo; to, xq, K, a) = Xo, we introduce the following definition. 
Definition 5 ((T, /^-stabilizer) Let fi < T be positive constants. The gain K is said to be a (T, /Lt)-stabilizcr 
for (4) if there exists a class JCC-function (3 such that, for every a G G(T,n), x G R", and t G R> , the 
solution of (9) satisfies 

\x(t;t ,x ,K,a)\ < (3(\x \ ,t-t ), Vt > t ■ 

Remark 6 Since we are dealing with linear systems (in the state) , it is a standard fact that one can rephrase 
the above definition as follows: the gain K is said to be a (T, ph)- stabilizer for (4) if (9) is exponentially stable, 
uniformly with respect to every (T, /x)-signal a. Here, uniformity means that the rate of (exponential) decrease 
only depends on (A, B) and [i, T. 



3 The neutrally stable case 

The purpose of this section consists of proving the following theorem. 

Theorem 7 Assume that the pair (A, B) is stabilizable and that the matrix A is neutrally stable. Then there 
exists a matrix K of size m x n such that, for every < n < T, the gain K is a (T, /^-stabilizer for (4)- 

Since the feedback K determined above does not depend on the particular class G(T, /x), we bring a positive 
answer to Question (Ql) in the case where A is neutrally stable. 

Remark 8 It can be seen along the proof below that the gain K = —rB T , with an arbitrary r > 0, does the 
job in the case where A is skew-symmetric and (A, B) is controllable. 

Proof of Theorem 7. Recall that a matrix is said to be neutrally stable if its eigenvalues have non-positive 
real part and those with zero real part have trivial corresponding Jordan blocks. The proof of Theorem 7 is 
based on the following equivalence result. 

Lemma 9 It is enough to prove Theorem 7 in the case where A is skew- symmetric and (A, B) controllable. 

Proof of Lemma 9. Let (A, B) be a stabilizable pair with A neutrally stable. Since the non-controlled part 
of the linear system x = Ax + Bu is already stable, it is enough to focus on the controllable part of (A, B). 
Hence, we assume that (A, B) is controllable. Up to a linear change of variable, A and B can be written as 

-(» £)• *-(£)■ 
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where A\ is Hurwitz and all the eigenvalues of A3 have zero real part. From the neutral stability assumption, 
we deduce that A3 is similar to a skew-symmetric matrix. Up to a further linear change of coordinates, we 
may assume that A3 is indeed skew-symmetric. From the controllability assumption, we deduce that (A3, B3) 
is controllable. Setting x = (xj ,xJ) T according to the above decomposition, the system (4) can be written 
as 

±1 = A\X\ + A 2 x 3 + a(t)B x u, (10) 
±3 = A3X3 + a(t)B 3 u. (11) 

Assume that Theorem 7 holds for (11), i.e., there exists K 3 such that, for every < /i < T, the gain K 3 is a 
(T, yu)- stabilizer for (11). Take 




where all entries of arc null. Then the conclusion for system (4) follows, since an autonomous linear Hurwitz 
system subject to a perturbation whose norm converges exponentially (with respect to time) to zero is still 
asymptotically stable at the origin. ■ 



Based on Lemma 9, we assume that A is skew-symmetric and (A, B) is controllable for the rest of the 
argument. We will prove that the gain K = —B T does the job. 

We consider the time derivative of the Lyapunov function V(x) = |a;| 2 /2 along non-trivial solutions of the 
closed-loop system 

x = (A - a(t)BB T ) x , (12) 
and get V = —a(t) |i? T a;| 2 , which can be also written 

v , Ab t x\ 2 



V w V 

Integrating both parts and defining x(-) as x(- ;t , Xo, K, a) and v(-) — V(x(-)), where (^7^0) an d ct denote, 
respectively, an arbitrary initial condition and an arbitrary (T, /^)-signal given arbitrary T > fi > 0, we get 
that 

T m dt =_r T a(t) \i^f dt . (13) 
»(*) i.„ »(*) 

Lemma 10 For every < /! < T, there exists a positive constant r\ such that, for any (T, fi) -signal a and 
any initial state \xq\ = 1, it holds that 

T+t ° \B T x(t)\ 2 

a{t) ] - -TT^-dt > r\. 



v(t) 

Proof of Lemma 10. Because of Remark 2 we take, without loss of generality, to = 0. We fix < fi < T 
and reason by contradiction, i.e., we assume that there exist a sequence {xoijigN such that |a;oi| = 1 for all 
i G N and a sequence of (T, /^-signals cti such that 

f T \B T x(t)\ 2 
lim / ai(ty- p-^-dt = 0, (14) 



I — >oo 



Vi{t) 



where Xi(-) denotes x(- ; 0, Xoi, K, ai) and Vi(-) = V(xi(-)). Since {xoijieN belongs to a compact set, there 
exists a subsequence {xo^jjiEN sucn that 

lim x 0i _ = x * , with |aro*| = 1 • 
J-.00 

On the other hand, recall that the space L°°(]R>o, [0, 1]) is sequentially weakly-* compact (see, for instance, 
[3, Chapter IV]), that is, for every sequence {f3i}i<=M C L°°(R> , [0, 1]) there exist /3* E L°°(K>o, [0, 1]) and a 
subsequence {Aj ljeN such that for every <p g L 1 (R> ,IR) the following holds 

/•oc />oo 

lim / Pi (s)<p(s)ds = / ^(s)cp(s)ds. (15) 
i-*°°Jo Jo 
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Therefore, we can extract a subsequence {ay. }jeN of {ayljeN which converges weakly-* to a measurable 
function a*. Note that a+ is itself a (T, /x)-signal. 

The convergence of ay. to a* implies a convergence of the solutions of their corresponding non-autonomous 
linear dynamical systems in the form (12): this is a particular case of the classical Gihman convergence 
with respect to time- varying parameters for ordinary differential equations (see [5] and also [8] for a general 
discussion in the framework of control theory). For the sake of completeness, and because the situation 
faced here can be handled with a specific and simpler approach, we include in the Appendix the proof of 
Proposition 21, whose statement allows to conclude that {xy(-)}j e N converges, uniformly on compact time 
intervals, to ay(-) := x(- ; 0, xq+, K, a*) as j tends to infinity. Letting iy(-) = V(x*(-)), one has, for every 

j eft, 



Oil (t) 



B T Xi, {if 



vAt) 



dt 



T ,J fiT **(*)| 



(ay (t) - a*(t)) J 77r J -dt ■ 



ay. (t) 



«*(*) 
B T x e _(t) 2 



-dt 



vAt) 



\ BT x*(t)\ 



dt. 



Letting j tend to infinity, taking into account the weak-* convergence of ay. to a*, and applying (14), we get 
that 



T ,jB T a;*(f)r 
a+(t)- — — — dt < liminf 

Vi,(t) j->oc 



< hm inf 



OLi> (t) 



B T xAt)'< 



|-B T o:*(i)| 



«<;(*) 



«*(*) 



B T s t -. (t) : 



\B T x*{t)\ 



vAt) 



«*(*) 



0, 



to on the interval [0, T]. Hence, 



(16) 
icq* for 



where the last equality follows from the uniform convergence of ay 
we conclude that 

a*(t)B T Xic {t) =0 

for almost every t G [0, T]. Furthermore, since is a solution of (12), we get from (16) that x+(€) 
t £ [0, T]. Moreover, since a* is a (T, /i)-signal, it is strictly positive on a subset J of [0, T] of positive measure, 
and then, according to (16), B J e At xo* must be equal to zero on J. Since the latter is real-analytic, it must 
be identically equal to zero on [0, T], and therefore the pair (A, B) is not controllable. This is a contradiction 
and thus Lemma 10 is proved. ■ 
By standard homogeneity arguments Lemma 10 together with (13) imply uniform exponential convergence 
of V to zero along every trajectory corresponding to a (T, /i)-signal. Theorem 7 is therefore proved. ■ 



4 The double integrator 
4.1 Scalar control 

This section addresses the same problem as above for the double integrator. For this, let 



o ; ■ u 





1 ) ' 



so that system (4) becomes 

±i = x 2l 
±2 = au, 

while, by considering K = (—kx, — fa), the closed-loop system (9) reads 

±x = x 2 , 

±2 = —a{kxx\ + fax2) ■ 



(17) 
(18) 

(19) 



Throughout the section we prove the following fact. 
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Theorem 11 For every < p < T there exists a (T, p)- stabilizer for (18). 

Again, we stress that, given any T > p > 0, the above result establishes the existence of a static linear 
feedback that globally asymptotically stabilizes (4) for the case that A and B are given by (17), for all 
(T, ju)-signal a. Theorem 11 therefore gives a positive answer to Question (Q2) for this particular case. 

Proof of Theorem 11. We first show how to exploit the symmetries of system (18) in order to identify a 
one-parameter family of problems which are equivalent to the research of a (T, /x)-stabilizcr. 
Lemma 12 Let X be a positive real number. Then (18) admits a (T, p)- stabilizer if and only if it admits 
a (T I 'A, pj A)- stabilizer. More precisely, (— ki,— fc 2 ) is a (T, p)- stabilizer if and only if (— A ki, — Afc 2 ) is a 
(T/A, p/ X)- stabilizer. 

Proof of Lemma 12. Let K = (— fci, — fc 2 ) be a (T, /x)-stabilizer and fix an arbitrary A > 0. It suffices to prove 
that (— A 2 fci, — Afc 2 ) is a (T/ A, /i/A)-stabilizer, the converse part of the statement being equivalent (just making 
1/A play the role of A). 

Applying to x(-) := x(- ; to, xq, K, a) a time-rescaling and an anisotropic dilation, we define 



Then 



Jt Xx{t) = A ( A ) i(At) = A ( A ) ( -ha(Xt) -kMXt) ) x ^ 

-X 2 k ia (Xt) -Xkla(Xt) )^(t)=Axx(t)-a(Xt)b(X 2 k 1 ,Xk 2 )xx(t), 
that is, 

xx(-) = x{- ; t 0l Diag(l, X)x , (-X 2 ki, -Afc 2 ), «(A-))- 

It is clear that a(A-) is a (T/A, ^/A)-signal if and only if a(-) is a (T, /i)-signal. Therefore, if (5 is a class /CX 
function such that, for every a € G{T 7 fi), xo G M 2 and to £ ^>o, 

|z(£;io,xo, A", a)| < P(\x \,t- t ) , Vi > < , 

then, for every a A G G{T/X,fi/X), x G R 2 and t > t > 0, 

\x(t;t ,x , {-X 2 ki, -Afc 2 ),a A (-))| = \x{t\ t , Diag(l, 1/A)x , K, a(-/X)\ < /?(max{l, 1/A} \x \ ,t- t ) ■ 

Since (s, t) i— > /3(max{l, 1/A}s,t) is a class /CX function, the lemma is proved. ■ 

We prove below Theorem 11 by fixing a gain K = (— k\,— fe) and showing that there exists A > such 
that (— A 2 fci, — Afc 2 ) is a (T, /^-stabilizer for (18). According to Lemma 12, this is equivalent to proving that 
there exists A > such that A is a (T/A, /x/A)-stabilizer. 

The first, obliged, choice is on the sign of the entries of K: a necessary (and sufficient) condition for the 
matrix A + bK to be Hurwitz is that k\,k% > 0. 

The choice of A will be determined by the following request: we ask that each matrix A + abK, with 
a G [fi/T, 1] constant, has real negative eigenvalues. Since the discriminant of 

det | °. , ) = a 2 + ak2cr + ak\ 

\ —aki —a — uk2 



is given by a(ak 2 — 4/ci), this sums up to imposing that 

ki < ^k 2 . (20) 

We fix for the rest of the argument a positive p < fJ,/2T and take A = (—pk 2 /2, —k) for k > to be fixed 
later. The choice of p and A is such that inequality (20) is automatically verified. For a G {p/T, 1}, define 
£° as the roots of 

nk 2 

£ 2 + ak£ + at-j- = 0, 
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with £2 < . In addition, let £1 and £i be given by 

G=-|(i + ^, C-:=-5( 1 -^-( a -0")- 

A simple calculation shows that 

c < el < # /T < e /T < t < e < o. (21) 

We next define a set of half-lines of the plane. Let D\ and D2 be the half-lines defined, respectively, by 
X2 = 0, x\ < and = 0, a?i > 0. Let, moreover, Dj_ and D± be the half-lines of the open upper half-plane 
defined, respectively, by the equations 

D%: x 2 =e±xi, D%: x 2 = £ Xl . (22) 

Finally, we define C±, C s , and C2 as the closed cones contained in the upper half-plane and delimited, 
respectively, by D\, D s _, then D s _, D s + , and D+, D2: see Figure 1. 




Figure 1: The cones d, C s , C 2 . 



A key step in the proof of Theorem 11 is to evaluate for how much time a trajectory of (19) stays in each 
of the three cones. 

Lemma 13 There exists a positive constant C\ — C\{p,T,jjL) (i.e., only depending on p, T, and fj,) such that, 
for every X > k, every (T/X, p,/X) -signal a, every 1, el 2 \ {0}, and every to > 0, if an interval I C R is such 
that the trajectory t 1— > x(t; to, x„, K, a) stays in C\ U C2 for every t £ I then the length of I is smaller than 
d/k. 

Proof of Lemma 13. Consider a € L°°(K>o, [0, 1]) and a trajectory x(-) := x(- ; to, x*, K, a) of (19) with 
1, 6 I 2 \ {0} and to > 0. Let I = [ti, t 2 \ be a time-interval such that x(t) belongs to C\ U C2 for every t E I. 
Using polar coordinates, x(-) can be represented as 1 1— > (r(t) cos 9(t), r(t) sin 9(t)) and one has 

• ±1 sin 9 - ±2 cos 9 . , / pk 2 , . \ 

6> = — = - sm 2 + a cos 61 I ^y- cos 6 + k sin J 

almost everywhere in /. Therefore, 

< -a ^sin 2 + k cos 6 sin + cos 2 0^ . 

We next show that there exists a positive constant c(p) such that 

9 < -ac(p)(sin 2 9 + k 2 cos 2 9), (23) 

almost everywhere in /. The claim can be proved by taking r := tan(0) and noticing that there exists c(p) > 
small enough such that if r < £?_ or r > ££_ then 

r 2 + kT+^>c(p)(T 2 + k 2 ). 
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Define now 

( arctan(^) if < 9 < tt/2, 

F(9) = I tt/2 if 9 = tt/2, 

{ arctan(^) + tt if tt/2 < 9 < tt. 

Notice that F is a continuous reparameterization of the interval [0, tt]. From (23), we get 

j t {F{9)) < -c{p)ka. (24) 

Therefore, F(9) is monotone non-increasing as long as x(-) stays in C\ UC2. If a is a (T/A, /x/A)-signal, 
then 

*(«(t+£))-W))<-^ (25) 

for every t with [i, t + T/A] c /. Let Z max be the largest integer such that / contains Z max disjoint sub-intervals 
of length T/A. Then (25) yields 

tt > F{9(h)) - F{9(t 2 )) > r ax ^4^ 



and thus 

/max < ^ 7r 



c(p)/ifc 
Hence 

t 2 -ti<r ax + l)y<^fT + Y. 

A c(p)pk A 

The lemma is concluded by recalling the hypothesis A > k. ■ 

From now until the end of the proof, let xq 7^ belong to the cone defined by D\ and D s + , i.e., to C\ U C. 
Let, moreover, to > 0, A > k, a G Q{T/X, p/X), and define x(-) := a;(- ; to, £0, aO- Then the following 
alternative occurs for x(-): 

(i) for every t >to, x(t) remains in C\ U C s ; 

(ii) x(-) reaches D s + in hnite time. 

In both cases, let [ioj*i] be the time-interval needed by x(-) to reach C s . Recall that, by Lemma 13, one has 
< ti — to < Ci/k. We notice the following fact, which results from a trivial computation. 
Lemma 14 The positive definite function V(x) := x\ + 2x\j ' pk 2 , evaluated along x(-), is non-increasing as 
long as x(-) remains in the fourth quadrant, i.e. {x G R 2 : x\ < 0, X2 > 0}. 

The following lemma provides an exponential decay result for trajectories staying in C s (in particular, for 
trajectories satisfying {%)). 

Lemma 15 There exist C2 = C^p, k,T, p) > and 7 = "/(p,T,p) > such that, for every t~>t\ such that 
x(-) stays in C s along the interval [ti,t], it holds that 

kWI^Cae-^-^lxol- (26) 
Moreover, Ci = 0{k) as a function of k as k tends to infinity. 

Proof of Lemma 15. Let t be as in the statement of the lemma. We deduce that, for r G (t 1 , £) , 

£2(7) = -fca(r)w(T)x 2 (T), 
where w(-) is a continuous function verifying 
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Notice that the bounds on w do not depend on k, due to the definition of £±. We are back to the (PE) 
one-dimensional case studied in the introduction. We deduce that there exist C* = C*(p, T, //) > and 
7 = j(p, T, fi) > such that 

x 2 (t) <C*e- k ^ t - t ^x 2 (h). (27) 



Notice now that, for every x G C s , 



\x\<xjl + j^, x 2 <k s j^} fj- 



The proof of the lemma is concluded by recalling that V(x(t 1 )) < V(a;o) and plugging the above estimates 
in (27). ■ 

Let us now establish a lower bound on the time needed to go across the cone C s . 
Lemma 16 There exists Xq > such that if X > Xq and xq G D s _ then x(-) stays in C s for all t G [to, to + 1]. 
Proof of Lemma 16. Fix xq G D s _. Reasoning by contradiction (and exploiting the homogeneity of (19)) 
we assume that there exist a strictly increasing unbounded sequence {Ai}i g N and a sequence {ajjigN C 
L°°(M>o, [0, 1]) with a, G Q{T/Xi,p/Xi) such that each Xi(-) := x(-;to,xo,K,ai), i G N, reaches D s + in 
time smaller than one. Because of the sequential weak-* compactness of L°°(R>o, [0, 1]), there exists a* G 
L°°(M>o, [0, 1]) and a subsequence of {Ai}i e N (still denoted by {Aijiew) such that {a^jigN converges weakly-* 
to a*. 

By Proposition 21, we deduce that the sequence {xi}i g N converges, uniformly on compact time-intervals, 
and in particular on [to-, to + 1], to £*(•) := x{- ; to, xq, K, a*). Since, for every i G N, Xi(-) reaches D s + in time 
smaller than one, we deduce that x*{to + 1*) G D 8 + for some t* G (0, 1]. 

Let us show that a* > fi/T almost everywhere on M>o. For every interval J C ffi>o of finite length I > 0, 
apply (15) to the characteristic function of J. Since each a\ t is a (T/Xi, /i/Aj)-signal, it follows that 



\ [ a±(s)ds = hm \ [ a* 

I J j l^OO I J j 



{s)ds > u ss f it 1 (t) = t 



where X(-) denotes the integer part. Recall that since a* is measurable and bounded (actually, L 1 would be 
enough), almost every t > is a Lebesgue point for a*, i.e., the limit 



1 f t+£ 
lim — / a+(s)ds 
2e J t _ e 



exists and is equal to a*(t) (see, for instance, [11]). We conclude that, as claimed, a*(£) > fi/T almost 
everywhere. 

Therefore, is actually a trajectory of the switching system 



u(A + bK T ) + (l-u) (A+^&A' T )] x, (28) 



where u is a measurable function defined on M>o and taking values in [0, 1] (see [1] and references therein for 
more on switching systems). According to the taxonomy and the results in [1, page 93], (28) is a switching 
system of type (RR. 2. 2. A) and, as a consequence, the curve x+ stays below the trajectory x of (28) starting 
from xq at time to and corresponding to the input u = 0. Since x converges to zero in the cone delimited 
by D s _ and D^ T , must stay in the same cone, contradicting the fact that x+ reaches D s + in finite time. 
Lemma 16 is proved. ■ 

Let us now focus on the behavior of trajectories exiting C s or, equivalcntly, such that xo G D s + . 
Lemma 17 There exists X\ > k such that if X> X\ and x Q G D s + then there exists a finite time tf > such 
that x(-) satisfies 

\x(t f )\ < \x \, (29) 

with x(tf) G Z?2 and x(t) G C 2 for all t G [fo,£/]. 
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Proof of Lemma 17. Fix xq G D s + . We reason again by contradiction and follow the same procedure as in 
Lemma 16. This is possible since, according to Lemma 15, the time needed by any trajectory of (19) to go 
across in C 2 is bounded (uniformly with respect to A > k and a G Q(T/X, /i/A)) by C\jk. We obtain that, 
for some to < t'j < C\/k, the limit trajectory is contained in C 2 on [io,iV], reaches D2 at time t'f, and 
satisfies |x*(iy)| > |xo|. According to [1], the trajectory x* is, inside C2, below the integral curve x^/ T of 
x = (A + ^bK T )x with initial condition x^/t^o) = x$. That means in particular that < 
where t'j is the first time larger than £ such that x^/t^/) G D 2 - However, a lengthy but straightforward 
computation shows that |^ ai /t(^/)I < l^ol an d we reach a contradiction. ■ 

Define A* = max{Ao, Ai} where Ao and Ai are the quantities appearing in the statements of Lemmas 16 
and 17. Whenever x(-) satisfies (ii) we let (ti <)£ 2 < £/ be such that x(t) G C s for t G [ti,t 2 ], x(t) G C2 for 
t G [t 2 ,tf], and x(t f ) G D 2 . 

As a final technical result for the completion of the argument, we need the following lemma. 
Lemma 18 There exist fc* = fc*(p,T, fx) > and"/* = 7, (p, T, /z) > smc/i £/ia£ ifx(-) satisfies (ii), tf—to > 1, 
k > k*, and A > A*, then 

\x(t f )\<h- k ^-^\x \. (30) 

Proof of Lemma 18. Applying estimates (26) and (29) we get that 

\x(t f )\ < \x(t 2 )\ <C 2 e- k ^-^\x \. 

Moreover, according to Lemma 13 and the hypothesis tf — to > 1, 

\x{t f )\ < C 2 e^ Cl e- k ' l{t '- to) \x \ < C 2 e 2 ~< Cl - k ~< /2 er k ' l{t '- to)/2 \x \ . 

The lemma is proved by taking 7, = 7/2 and fc* large enough in order to have C2e 2lCl ~ k ~ 1 I 2 < 1/2. Such a fc* 
does exist because, in view of Lemmas 13 and 15, neither C\ nor 7 depend on k, while C 2 = 0(k) as k tends 
to infinity. ■ 



We have developed enough tools to conclude the proof of Theorem 11. Take k > fe* and A > A». Let 
£0 G M 2 \ {0}, to > 0, a G Q(T/X, fi/X), and denote by T the set of times such that £(■) = x(- ; to, £,0, a) belongs 
to the ii-axis. Choose one representative for every connected component of T. Denote by T the set of such 
representatives and by j G N U {+00} its cardinality. By monotonically enumerating the elements of T', we 
have T' — {ti | < i < j} with r,_i < r, for < i < j. Let, moreover, r_i = to and Tj = +00. Since, for 
every —1 < i < j, either £(■) or —£(•), restricted to (T,,Tj_|_i), is contained in the upper half-plane, then the 
previously established estimates apply to it. 

Take — 1 < i < j and t G [t^, Tj+i). Then there exists C3 = C%(K, T,fx) > 1 such that 

KWI^e-^-^rOI. (31) 

Indeed, let 

«i = sup{s G [n,t] I £([t«,«]) C Ci or _£([ Ti ,s]) C d}, 
s 2 = inf{sG [ri.t] | £([«,*]) cC 2 or -£([«,*]) C C 2 }, 

and notice that max{si — r;,t — s 2 } < C\jk. Then (31) immediately follows from Lemma 15. 
In particular, if j > then 

ie(r )| <C 3 e- k ^»-to) lU 
Moreover, for every < i < j, Lemma 18 yields 

^^le-^-^ian-i)], 

which implies, by recurrence, that 

\^Ti)\<\e- k ^- T °>|£(t )|. 
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Therefore, independently of j, for every — 1 < i < j we have 

\Z(n)\ <C 3 e- k ^- t0 %\. 

Applying again (31) we obtain that for every t G [to, +00) = Ui=i [ r »-ii T i)- 

m)\<c 2 3 e- k ^^\^\, 

which proves Theorem 11. ■ 

Let us go back to the natural question posed in (Ql), that is, whether the choice of a stabilizer K can be 
made independently of T and /1. Unlike the case when A is neutrally stable, we prove below that the answer 
is negative when the double integrator is considered. 

Proposition 19 For every K G R 2 , there exist T > [i > such that K is not a (T, /i)- stabilizer for system 
(18). 

Proof of Proposition 19. Let K = (— ki, —k 2 ) G R 2 . If k 1 < or k 2 < then A + bK is not Hurwitz and 
thus K is not a (T, /Lt)-stabilizer for system (18), whatever \x and T. Let now k\,k 2 > 0. Among the possible 
configurations of the right-hand side of (19), we focus our attention on the linear vector fields Lq and L\, 
corresponding to a(t) = and to a(t) = 1 respectively, that is, 



Lq{x) := Ax , L\(x) := 



1 

— k\ — k 2 



Consider the set where Lq and L\ are collinear, i.e., the union of the axis {x 2 = 0} and the line D defined by 

D := {( Xl ,x 2 ) e M 2 I X2 = ~{ki/k 2 )x l } . 

We denote by Qi,Q 2 ,Q3, and Q4 the four regions of the plane delimited by these two lines and defined as 
follows 



Qi 

Q-2 



{{xi,x 2 ) e R 2 I x 2 > -(ki/kzjxi ,x 2 > 0}, 
{(xi,x 2 ) G R 2 I x 2 > -(ki/k2)xi ,x 2 < 0}, 
{(0:1,0:2) e R 2 I x 2 < -(ki/k 2 )x! ,x 2 < 0}, 
{(xi,x 2 ) G R 2 I x 2 < -(ki/k 2 )x! ,x 2 > 0}. 



C(x) = 



Roughly speaking, on Q 2 UQi the vector field L\ points "more outwards" than Lq (with respect to the origin). 
Therefore, on Q 2 U Qa the excitation (a = 1) is not helping the stability towards the origin (see Figure 2). 

We look for a "destabilizing" a in the form f (x(-)), where x(-) is an unbounded solution corresponding to 
the feedback 

1 if a; <E Q 2 UQ 4 , 
fi/T if xeQ^Qs, 

(i and T to be chosen. Clearly, any a obtained in such a way is a (T, /^)-signal. (It should be stressed that 
although C is a discontinuous feedback, its solutions are anyway well-defined because all trajectories of (18) 
are rotating around the origin). 

Let x be the first intersection with D of the trajectory of (19) starting from (—1,0) and corresponding 
to a = 1. Notice that there exists v > small enough such that the trajectory of (19) starting from x and 
corresponding to a = v crosses the rri-axis at a point (£,0) such that £ > 1. This is because as v — > such 
trajectories converge uniformly on compact intervals to the horizontal curve 1 1— > e tA x. 

Fix T > fi > such that fi/T > v. Then the trajectory x(-) of (19) starting from ( — 1, 0) and corresponding 
to the feedback £ first leaves the upper half-plane through [£, +00) x {0}. Then, by symmetry and homogeneity 
of the system, \x(t)\ goes to infinity as t — ► 00. Thus, a(t) = £(x(t)) is the required destabilizing signal. ■ 

4.2 Non-scalar control 

It makes sense to consider the stability properties of the system whose linear dynamics is the same as that of 
the double integrator, but which has a different controlled part. That is, we study system 



1 




aBu, xGR 2 , uGR"\ (32) 
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Figure 2: Partition of the state-space into the four regions Q\, Q2, Q3, Qa- 

where B is a general 2 x m matrix such that the pair (A, B) is controllable (A denotes the nilpotent 2x2 
matrix appearing in (32)). Since the image of A is one-dimensional, the controllability of (A,B) implies the 
existence of a column b of B such that (A, b) is controllable. Moreover, by a linear change of coordinates, we 
can transform (A, b) into its Brunovsky normal form, that is, into the matrix A and the vector b = (0, 1) T 
as in (17). Therefore Theorem 11 guarantees that for every pair of positive constants fj, < T there exists a 
(T, /^-stabilizer for (4). 

The difference with respect to the scalar case is that Proposition 19 is not valid anymore when the rank 
of B equals two, that is, the answer to question (Ql) becomes positive. 

Proposition 20 If rank(_B) = 2, then there exists K of size my. 2 such that for every T > /1 > the gain K 
is a (T, fi)- stabilizer for system (32). 

Proof of Proposition 19. Let us remark that, up to a reparameterization of M. m of the type u' = Mu, M 
invertible, we can rewrite B as (Id 0), where Id is the 2x2 identity matrix and all the entries of the 2 x (m — 2) 
matrix are null. That is, (32) is equivalent to 

x = Ax + au, i£l 2 , ueR 2 . (33) 

Fix k > and take u = —kx. If £ 1 — > x{t) is a solution of 

x = (A — afcld)a;, 

then 1 1 — ► y(t) := e~ At x{t) satisfies y = —kay. Therefore 

y(t) = exp ^-k J a(T)dT^J y(0) , 

which implies that 

\x{t)\ < \e At \ exp (-k a(r)dr) \x{0)\ . 

Since e At = Id + tA is linear in t, we have proved that for every T > /i > and for every k > the gain 
K = —kid is a (T, /i)-stabilizcr for system (33). ■ 

5 Appendix 

We first provide a simple result used several times in the paper. 
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Proposition 21 Consider system (9), where A, B, K are matrices of size nxn, nxm and mxn respectively, 
and a is a (T, fx) -signal. Take a sequence xoi of norm- one vectors converging to so* and a bounded sequence 
cti in _L°°(R) which converges weakly-* (in L°°(1R)J to a measurable function a*. Then the sequence {xi(-) :— 
x(-, 0, Xoi, K, cti)}i£jq converges, uniformly on compact time intervals, to £*(•) := x(-, 0, xo+, K , a*) as i tends 
to infinity. 

Proof of Proposition 21. Recall that the weakly-* convergence of a,; to a* means that, for every tp G 
L 1 ^,!), it holds that 

/>oo />oo 

lim / ai(s)<p(s)ds = / a+(s)ip(s)ds . 
i-* 00 Jo Jo 

Taking as ip the characteristic function of an arbitrary interval of length T shows that a* is a (T, /i)-signal. 
Moreover, the norm of xo* is equal to one. For i 6 N, set 

e»(-) = Xi(-) - £*(•), e ai = x i - x *, 

Ai(-)=A + ai(-)BK, 

and let <f>i(-, •) be the fundamental solution of x = Ai(t)x. Integrating the differential equation verified by ei, 
one gets, for t > 0, 

e.i(t) = / Ai(s)ej(s)ds + 
Jo 

where = 4>i(t, 0)eoi + /plaiCs) — a+(s))BKx*(s)ds. Note that the functions ftj are uniformly bounded 
over compact time-intervals and the sequence they define converges point-wise to zero as i tends to infinity. 
Therefore, by combining Gronwall Lemma and the bounded convergence theorem, it follows that the sequence 
{ei(-)}jgN converges point-wise to zero as i tends to infinity. The uniform convergence on compact time 
intervals results from the above combined with Ascoli theorem. ■ 
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